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In compliance with Public i.uw 8i)-{ii>J, an aitrecmont between the 
department ot* Health, UJucation, and Welfare and Gallaudet Collei;e was 
siiincU on May 16, 1969, authorizing the establishment, construction, 
equipping, and operation of u Model Secondary School for the Deaf (iMSSDj. 

The legislative mandate reflected within the Public Law assigns 
the MSSl> the interrelated goals of: (a) serving as a laboratory for 
educational and instructional models; {b) disseminating working models 
throughout the field of education of the deaf in order to have an impact 
upon the education of more than 60,000 deaf student*? in schools and 
programs, their parents, and the 10,000 professional persons in education 
of the deaf and related disciplines; (c) preparing deaf adolescents for 
post -secondary academic and/or vocational pursuits; and, (d) providing 
deaf adolescents the skills necessary to become effective members of 
society. The first two goals relate to the national scope of the NISSD, 
while the latter two goals relate to the instructional program of the MSSI). 

The Office of Research and Lvaluation (ORE) of the MSSD has compiled 
this Occasional Paper which illustrates the diversity of the current 
investigations of the ORE. These investigation were undertaken to 
satisfy both the national and immediate goals of the MSSD. 

The papers were specifically selected for their differences rather 
than their similarities. We are tiius hopeful that sufficient interest 
may be generated that mutually beneficial dialogue will result from the 
sharing of this information. 



Joseph Rosenstein, V'nAK 
Director 

Office of Research and r.vahintion 
July, 1974 
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Olio the components of the Model Secondary School for the 
Ooaf (MSSn) involves the development of instruct ion:il materials, am! the 
/.election and 'or production of appropriate support media. In order to 
select or develop mediated instructional materials which can and will 
he used l>y educational programs for the deaf, MSSD needed to determine 
the current and projected media capahilities of schools for the hearing 
impa i red . 

The Office of Research and Evaluation (ORH) of MSSD conducted a 
mail survey of IhS residential and day programs for the hearing 
impaired. ProRrams which were identified as puhlic school class 
programs were not included in the sample as these programs are not 
the major consumer population of MSSP product development efforts. 
PuMic school programs were also more likely to have availahle, either 
directly or through a school system loan basis, meilia equipment and 
materials. Responses were received from 125 programs, a return. 
These programs educate approximately 25,000 students. 

Of the 125 schools, two educating residential students only, 
58 having day programs only and 52 combined residential and day programs 
responded to the survey. I- 1 even other programs returned the survey h\it 
did not specify tx'pe of school. 

Of particular interest to the MSSH were the 75, or 59. 5», of the 
responding schools which had a secondary program. Forty-three schools, 
SS.O^l), indicated •'other'" as a t\7>e of program. This was often further 
specified as vocational programs. The responding programs indicated a 
total of 9,515 students age 15 and older enrolled. Students from 



7 to 12 years of age were enrolled in 113 programs and accounted for 
791 hearing impaired students. In the 0-6 year age range, 112 schools 
had a total of 2,768 students. 

Residential Only Schools^ 

Responses from the tiifo residential only schools indicated that 
neither school had 16 mm cartridge projectors, color video monitors, 
cassette video recorders, 35 m cameras, diazo transparency producers, 
photocopiers or cable TV systems. 

Both schools had at least one 16 mm reel to reel projector, 
cassette audio recorder, 2x2 slide projector, carousel slide projector, 
instamatic camera, SB movie camera, and thermofax transparency producer. 
One of the two schools has at least one of the remaining media items 
which were listed on the Media Questionnaire. 

Anticipated acquisitions were analyzed in terms of current levels 
of availability. For exanple, neither of these tw schools had 16 mm 
cartridge projectors at the time of the survey and neither intended to 
acquire any within the next three years. Of tht seven surveyed media 
items not currently available to either school only one item, a 
cassette video recorder, is an anticipated acquisition in the next 
three years. 

Currently available items which neither school planned to add to 
present resources are film and slide projectors, still cameras, 
overhead transparency producers, photocopiers and cable TV. 
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Day Only Programs 

At least soli (or 47 schools) of the responding Day Only Schools 
did not currently have the following media equipsent available for 
students: 16 bbb cartridge projectors » S8 sound projectors, color 
video nonitors, cassette video recorders, 16 mm movie eras, diaso 
transparency makers, and cable TV svstems. At least 80% (47 schools 
or more) had at least one 16 m reel to reel projector and at least 
one thermofax transparency producer. 

Of the 47 (80%) or more schools which did not have at least 
one of the media items noted above, at least one of the schools intends 
tc acquire some of these equipment items within the next three years. 
*fhree schools intend to acquire 16 mm cartridge projectors, and two 
expect to have S8 sound projectors available within three years. Eight 
schools which currently have -oMr video monitors expect to acquire 
at least one, and seven schools expect to acquire cassette video 
recorders. Only one school which does not currently have a 16 mm 
movie camera intends to acquire one. Three schools intend to have 
diazo transparency producers available in their school in three years, 
and four schools plan cable TV systems. 

Combined (Day and Residential) Schools 

Of the 52 responding schools which have both Residential and 
Day Programs, at least 80% (42 or more schools) have at least one 

o 
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3S ran fUmstrip projector » overhead projector and prcjector screen. At 
least 80 0 of these schools did not have any 16 ran cartridge projectors and 
cassette video recorders. 

A sinsaary of the expected acquisition of nedia resources over 
the next three year period for sctiools with both residential and day 
class programs by current level of resource availability was prepared, 
livery iteiti on the media resource list *tas an anticipated acquisition 
by at least one of the schools with both day and residential programs. 
At least twenty of the S2 schools intend to acquire the following items: 
16 tm reel to reel projectors; casssctte audio recorders; color video 
nK>nitors: video cameras; <"arousel projectors, polaroid cameras; and 
instaraatic cameras. 

Total Material Availability 

Items most frequently found in the reporting programs were: thcrmofax 
transparency producers (80.3% of the programs), overhead projectors (74.6%), 
polaroid cameras and reel-reel audio recorders (both 73.7%). carousel 
projectors (72.1%), and casse*-te audio recorders (68.7%). 

Items least frequently found were cable TV systems (31.2%), color 
video monitors (29. 5o), 16 mm movie cameras (26.2%), cassette video 
recorders (18.3%) and 16 mm cartridge projectors (9.0%). 

One of the largest areas of anticipated growth seems to be occurring 
in the planned acquisition of video equipment. Approximately 20% more 
schools will have cassette video recorders within three years and 18% 
moie schools will have color video monitors within three years. 



Summary 

The data provided by those schools responding to this survey will 
prove highly useful to the curriculum development efforts as well as 
research endeavors conducted by rhe Model Secondary School for the Deaf. 

The data provided by this survey can and should be interpreted 
differently depending upon the needs and objective? of the consumers. 
The Intent of this particular report is primarily to briefly describe 
the data and summarise the findings. 
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\\ lAAUIAllON OP CAI STRANDS <:URRiaiUfM AT MSSI) (1971-72 anU 1972-73) 

Haviil Kniijht 
OTficc of Research and Uvaluation 
Novemlier, 1973 

INTRODUCTION: GtiNtlRAL DLSCRIPTION OF TIU; CAI STRANDS CURRICULUM 

The CAI MathcHatics Strands Curriculiun, developed by the Institute for 
Mathematical Studies in the Social Sciences at Stanford University is a drill 
and practice program de^^igned ''(a) to provide supplementary individualized 
instruction in elementary mathematics at a level of difficulty rppropriatc to 
each student^s level of achievement, (b) to a-low acceleration in any concept 
area in which a student demonstrates proficiency, and to allow repeated drill 
and practice in areas of deficiency, and (c) to report a daily profile of each 
student's progress through the curriculum" {Suppes, et. al., 1973, p. 7). 

The Strands are mathematical activities with problems of a like nature 
arranged sequentially with respect to difficulty. The Curi-iculum offers 14 
different Strands rariging in grade placement (CiP) level of difficulty from 
1.0 years entry to "-9 years exit. The reader is referred to Suppes, et«al.» 
1975, for a more detailed description. 

Students arc general 1; placed on the Strands at a level equivalent to 
their grade placement in school. The first ten sessions allow for rapid 
movement within the Strands itntil the student's current level of mathematical 
functioning is established. iTic program presents problems from all of the 
Strands the student is worthing on, in mixed order, during each session. 

After initial placement the student advances through the Strands program 
according to the nun^er of correct or incorrect responses made to the problems 
previously presented. Each new session picks up where the old session left 
off. Each student may be working on different Strands at different levels 
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because moveinent through the program is individuals-Independent of the 
perfcrmance of any other student or class. The model of iMvement through 
the Strands . . defined so that a student with average performance 
gains one year's HP in one school year of CAT time which ranges from six 
to ten minutes per school day.'* (Suppes, et. al.» 1973, p. 11) 

The MSSD Strands Curriculum generally operated as described ^ove. 
The one departure was that Stanford Computation subtest scores were used for 
initial placement in the program as the MSSD is non-graded. Students 
carried over the summer were entered in the fall at .5 year lower than they 
had exited the previous spring. 

In addition to GP on individual Strands an Average Grade Placement (AGP) 
shows the overall position of the student in the program. The AGP is simply 
a weighted mean GP across all Strands the student is working on. 

Another measure of student performance on the Strands reflects the rate 
of progress for each student. Thin measure is different from the AGP in 
that it takes into account the time factor. Therefore a standardized rate 
number of .10 represents the student who will complete one year of Strands 
Curriculum in one school year. A figure higher than this would indicate that 
the student would complete more than one year of Strands Curriculum in one 
school year and vice versa. 

ANALYSES 

PRELIMINARY CAUTIONARY NOTE : The analyses reported here were performed ex 
post facto; that is, no attempt was made prior to the initiation of the CAI 
Strands Curriculum in 1971 to design an evaluation plan or strategy to test 
the effectiveness and/or impact of the CAI. Consequently, several areas of 
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potential analytic interest cannot be pursued because of lack of appropriate 
data, records » and design. 

The data available for analysis included all students who had at one time 
or another "signed on*' the computer, irrespective of their tenure in the 
Strands. It was decided that students who had not spent sufficient time in 
the Strands for appreciable achievement to have occurred would be eliminated 
from the analyses. The criterion adopted was completion of at least 20 
sessions in the Strands. Entry level AGP was taken from the first available 
computer printout after the student had completed ten sessions (inasmuch as 
the first ten sessions are designed to ascertain the student's actual level of 
math functioning). 

The analyses that follow are for the 1971-72 CAI program and the 1972-73 
CAT program, with discussion, conclusion, and recommendation sections follow- 
ing. 

1971-72 CAI STRANDS CURRICULUM ANALYSIS 

While 85 MSSD students were assigned to the Strands during the 1971-72 
school year, S2 students met the criterion for Inclusion in this analysis. 
The entr>' level AGP was determined at an average of 11.63 sessions. The 
students showed a mean AGP gain entry to exit of 1.05 years (s».97). An 
average of 2389.5 problems (s=1922.4) was completed in a mean number of 
61.85 sessions is=53.46). An extreme is illustrated by one student who 
finished the entire Strands program with 8733 problems worked in 272 sessions. 

The data reported above are extremely varied when the large standard 
deviations are compared with their respective means. The number of problems 
completed ranged trom 577 to 8733 problems (over 8000 problems). In other 
words, students within the group approached the program with virtually no 
consistency of effort. 
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A significant correlation of .85 (tsll.56; df«50; significance greater 
than .001) between number of problems worked and AGP gain reveals a definite 
linear relationship between the two. In other words, the more problems a 
student worked the more he achieved in AGP at exit. 

Correlations between AGP gain on the CAI Math Strands and gain scores 
on the Stanford Achievement Test math subtests were computed to ascertain the 
relationship, if any, of the CAI Strands program with standardized math 
achievement subtest scores. We recognize that certain disparity may exist 
between the scalar units used to report achievement in the CAI program and in 
the Stanford Achievement Test: while both are expressed in terms of grade 
level, they may not be totally compatible. In addition, most of the Strands 
have a ceiling of 7.9 AGP level whereas the Stanford has a ceiling of 12.9 in 
the Math subtests for the Advanced Batter)-. Examination of the data, 
however, reveals that the ceiling effect occurred minimally on the CAI and 
in itself does not seriously affect the validity of the correlations performed. 
Nevertheless, a somewhat cautious approach to the interpretation of the 
correlations reported below is suggested. 

Table I below presents the results of the correlations. The results 
indicate little relationship between achievement in CAI and in Stanford Achieve- 
ment Test math subtests. One correlation between AGP gain and computation 

TABLE T 

:.!ATRIX OK CORRELATIONS BETWEEN AGP GAIN 
AIsT- ■-.Ain on r.ELSCTED .TA'F'^FP rUPTErT" BY BATTERY LEVEL (71-72) 



nt an ford 
Level 


Arlth. 
ConiT'utation 


Arlth. 
Concepts 


Arith. 

Application 


N 


T!JT T 


-.ZOO 


.071* 


-.096 


12 


iirr II 


.123 


-.OlU 


-.038 


17 


ADV 


.135 


.3lU 


.326 


21 
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gain on the INT I level approaches significance and shows a negative 
relationship between the two. In this instance there is a trend for better 
achievers on CAI to be poorer achievers on the Computation Subtest. 

One would logically expect a high correlation between the CAI AGP gain 
and Arithmetic Computation because both are primarily computational in 
nature. However, the results did not bear this expectation out. Even more 
perplexing was the negative relationship for the Intermediate I group. 

Spearman rank (non- parametric) correlations were computed on AGP gain 
and Computation gain because of suspected non-normal distributions of the 
gain scores attributable to the relatively small Ns and extreme variability 
mentioned previously. Hence» if the non-parametric correlations approxima- 
ted the parametric correlations one cowld assume that the normal distribu- 
tion assumption underlying the use of parametric correlations was not unduly 
violated. 

The results of this comparison are presented in Table II. There is 
considerable disparity in the INT I comparison between parametric and non- 
parametric measures. This lends credence to the suspicion that the INT I 
gain scores were not normally distributed and the parametric correlation was 
spurious. 

TABLE II 

COMPARISON OF PARAMETRIC AND N0N-PARAf4ETRIC CORRELATION COEFFICIENTS BETWEEN 
AGP GAIN AND ARITHMETIC COMPUTATION GAIN BY STANFORD BATTERY LEVEL 1971-72 



Stanford r 

Battery N 

INT I -.509 -.030 12 

INT II .123 .161 17 

ADV .135 .20it 21 
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The INT tl and ADV comparisons show the non-parametric correlations 
representing slightly stronger but still non-significant relationships. 
Differences existing between the parametric and non-parametric coefficients 
here are not large enough to cause serious concern over the normalcy of the 
data at the INT II and .iDV levels. 

An additional comparison was made between the Stanford gain scores of 
students meeting the criterion for inclusion in the analysis and those who 
did not, in order to shed some light on the lack of relationship between 
the CAI Strands achievement and Stanford achievement. Hence» Stanford gains 
are compared for the CAI and a non-CAI group, even though some students in 
the non-CAI group did have minimal exposure to the Strands (less than 20 
sessions completed). 

TABLE TTI 

A c:^r.TARiroK or achte\'E!ent on stajiford math subtests of students 





sTUDKirrr 


HOT 


INCLUDED 


IN THE 


CAI STRANDS AT MSSD 1971 


-72 






ARITH. 






ASITH. 






ARITH. 




JTATIrORD 


COTUTATICN 




COrCEPTS 


APPLICATION 


BATTERY 






MEAII 




NON- 


^^EA]^ 




NON- 


IffiAN 




CAI 


CAI 


DIFF. 


CAI 


CAI 


DIFF. 


CAI 


CAI 


DIFF. 


irrr t x 






.UB 


.01 


1.12 


-.21 


.59 


.22 


.37 


s 


.56 


.63 




.63 


.91 




.77 


.5h 




:i 


i: 


n 




12 


11 




12 


11 




IKT II X 




1.08 


.33 


.16 


.;.:3 


-.07 


l.li* 


.38 


.76» 


s 


l.OT 


1.5C 




.70 


.83 




1.17 






N 


15 


12 




15 


12 




15 


12 




ADV X 


1.0? 


.ho 


.C2 


.51 


.30 


.21 


.69 


-.12 


.81* 


s 


1.3^* 


.19 




1.2? 


.88 




1.01 


.86 




:i 


21 


11 




21 


11 




21 


11 





*r!ignifieanc?e greater than .05 (t testr. for sipinifi cance of the difference 
between rieans). 



Table III reports the comparative results. No control over any variable 
other than inclusion or non* inclusion in CAI Strands was possible. That is» 
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other factors could have incluenced performance on the Stanford subtests 
in addition to the influence of the CAl program. Consequently, caution 
should be used in interpreting the results in Table III. 

Examination of Table III shows the CAI group exhibiting greater achieve- 
ment in seven of the nine possible comparisons. While only two of the com- 
parisons showed a' significant difference it is interesting to note that the 
trend favored the CAI group in terms of greater achievement on the Stanford 
Math subtests. This is somewhat surprising as it was earlier reported that 
the gains in achievement on CAI were not related to gains on the Stanford. 

A correlation between AGP gain and number of units completed on the 
Individual i2ed Mathematics Systems (IMS) proved to be non-significai»t 
(r».214; t»1.43; df«42) . In other words, gain achieved on the CAI Strands 
was largely independent of gains achieved on the IMS, which is somewhat 
surprising considering that the Strands is essentially a drill and practice 
program. 

1972-73 CAI STRA\DS CURRICULUM ANALYSES 

Out of 57 students assigned to the computer program, 34 met the criterion 
for inclusion in the analyses. The entry level AGP was recorded, on the 
average, at 12.35 sessions completed. These students showed a mean AGP gain 
of .81 years (.S'72) over all Strands. The students worked, an average of 
1272.67 problems (s«997.75) in an average of 65.91 sessions (5*45.98). On© 
student completed the Strands in 159 sessions with 3758 problems worked. 
As with the 1971-72 analyses, the data were extremely scattered as shown by 
the large standard deviations relative to the means. The correlation between 
the number of problems worked and CAI AGP gain was .87, significant beyond the 
.01 level of confidence (t^9.92; dfa32). Correlations between CAI AGP gain 



;in«i Stanford Achievement math subtest gains are presented in Table IV. 



TABLE IV 



MATRIX OF CORRELATIONS BETWE"ri AnP (JAIN AND GAIN ON 
:.-KLECTKD CITANEORD SUBTEnT;.=5 BY GTANFORD BATTERY 




Arlnh. 

Conyrutation 



Arith. 
ConcetDts 



Arith. 
Application 





.266 
.10? 
.21? 



.227 
.333 



9 
10 

15 



No significant relationships between AGP gain and the Stanford subtests 
were obtained. The negative non-significant correlation for the INT II Compu- 
tation subtest which approaches significance is surprising in view of what 
might logically be expected. 

As with the 1971-72 analyses, the normalcy of the distributions was 
questioned because of the relatively small Ns and the wide scatter of the data. 
Consequently, non -parametric correlations were computed on the Computation 
subtest, compared with the parametric measures, and are presented in Table V. 



COMPARISON OF PARAMETRIC AND NON-PARAMETRIC CORRELATION COEFFICIENTS 
BETWEEN AGP GAIN AND ARITHMETIC COMPUTATION GAIN BY STANFORD BATTERY 1972-73 



TABLE V 



Stanford 
Battery 



r 



N 



INT I 
INT II 
ADV 



.273 
-.522 
.367 



.150 
-.538 
.408 



9 

10 
15 



Generally, the parametric correlations are supported by the non-i>aramctric 
measures. The comparison for INT I would raise some doubts as to the normalcy 



of the distribution. It is interesting to note that the strong negative 
correlation was non-parametricaliy supported here, whereas it was not 
for the 1971-72 analyses. 

The comparison between Stanford Math achievement subtest gains of CAI 
vs. non-CAI M5.SD students was completed, with the same criteria and cautions 
mentioned for the 1971-72 analyses. These results are shown in Table VI. 

TABLE VI 

COiPARISON OF ACHIEVEMENT ON STANFORD MATH SUBTESTS BETWEEN STUDENTS 
INCLUDED AND NOT INCLUDED IN THE CAI STRANDS AT MSSD 1972-73 









ARITH. 






ARITH. 






ARITH. 




STANFORD 


COMPUTATION 




CONCEPTS 


APPLICATION 


BATTERY 






NON- 


MEAN 




NON- 


MEAN 




NON- 


MEAN 




CAI 


CAI 


DIFF. 


CAI 


CAI 


DIFF. 


CAI 


CAI 


DIFF. 


INT I 


X 


-.09 


.11 


-.20 


.12 


.16 


-.04 


.32 


.82 


-.50 


S 


1.07 


.70 




1.35 


1.11 




1.23 


.93 






N 


9 


17 




9 


17 




9 


17 




INT II 


X 


.69 


.45 


.24 


.26 


.89 


-.63* 


1.19 


1.19 


0 


s 


1.21 


1.03 




.58 


.94 




1.14 


.66 






N 


10 


15 




10 


15 




10 


15 


-.45 


ADV 


X 


1.21 


1.17 


.04 


.83 


.83 


0 


.28 


.73 


s 


1.11 


1.24 




1.38 


1.27 




1.08 


1.70 






N 


15 


19 




15 


19 




15 


19 





♦Significance greater than .05 level, t test of significance of the difference 
between means. 



Examinaticn of Table VI shows the CAI group having greater achievement in 
two comparisons, the non-CAI group having greater achievement in five comparisons, 
and both groups equal in two others. This differs from the comparisons reported 
for the 1971-72 groups (where seven of the nine comparisons favored the CAI ^ 
group in terms of greater achievement). One significant difference was shown 
in favor of the non-CAI group on the Concepts subtest for INT II. 

A significant correlation of .55 (t=3.09; df«22; significance of t greater 
than .01) was found to exist between AGP gain and number of units completed 
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IMS. A Spearman rank correlation was computed to substantiate the significant 
relationship since nonsignificance was noted for the same coiBparlson in the 
197I«72 analyses. Ute resultant rank order correlation was .224 (t«1.19; 
d£=22; non-signif leant) and did not substantiate the parametric correlation. 

DISCUSSION 

a)^^pARATIVE gains and achievement ; 

Comparison of certain results reflect the relative effort expended by the 
students in each year of the Strands program at MSSD. In terms of effort, the 
1971-72 group showed a mean of 2589. S problems worked in an average of 1272.7 
problems in a mean of 65.91 sessions. In other words* the 1972>73 group 
required a few more sessions to work approximately half the number of problems 
than did the 1971-72 group. 

The face that the 1971-72 group gained more than did the 1972-73 group is 
not surprising due to the strong relationship noted between problems worked 
and AGP gain. However, the mean difference in AGP gain of .24 years 
between the groups was statistically non-significant (t^LSO; df«52) which 
indicates that the difference between groups could be attributed to chance 
factors independent of the Strands. Referring to the strong correlations 
reported for both groups between problems worked and AGP gain, one would 
expect that the mean AGP difference would be greater because of the larger 
number of problems worked by the 1971-72 group. The fact that it was not 
greater suggests that while the 1972-73 group was less efficient in terms 
of effort it was more efficient in terms of learning: less problems worked 
to produce a comparable gain in AGP. 

Hie lack of a greater difference in AGP gain cannot be attributed to 
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differences in the groups' entry achievement level, AGP or Stanford Compu- 
tation subtest. The two t^ups did not differ significantly in terms of 
entry and exit achieven^nt on Arithmetic Computation although the 1972-73 
group showed slightly greater achievement on both. The mean score entry 
level (across all Batteries) for the 1972-73 group was 6.23 years 
(s-1.96) compared with the mean of the 1971-72 group* 5.88 years (s«l.57). 
Similarly, the 1972-73 group's mean exit level was 7.08 years (s«l.96) 
and that for the 1971-72 group was 6.95 (s«1.96). In addition, there was 
no significant difference between the groups on entry AGP level as the 
1971-72 group mean entry AGP level was 4.31 years (s«1.22) and the 1972-73 
mean was 4.29 years (s=1.52). It is possible that the lack of a significant 
AGP difference between the groups might be explained as a function of 
selective factors operating within the 1972-73 group. That is, the 1972-73 
group through some selective process was more amenable to the Strands 
approach to learning, and thereby, was better able to make use of the drill 
provided by the problems in terms of AGP gain. 

Another possible explanation is that the relationship between problems 
worked and AGP gain, though strong, was not strictly linear. In other words, 
after "laving completed a certain number of problems, the learning efficiency 
of the student decreased, analogous to having reached a saturation point. 
It might be that the 1971-72 group had reached or passed this point, while 
the 1972-73 group had not. It cannot be ascertained, however, if this would 
be a function of the Strands program itself, or of the learning style of 
the students In each group. 

The lack of significant positive relationships between AGP gain and 
achievement on the Stanford math subtests, particularly the Arithmetic 
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Confutation subtests is both surprising and disturbing. Iliere should be 
a strong relationship between the two since both are primarily cooputational 
in nature. The fact that the data reveal essentially no relationships 
between the two indicates that they were operating independently of each 
other: gain in AGP did not relate to gain in Stanford achievement. 

There are a number of interpretations for the lack of relationship. The 
Strands reports student progress in terms of AGP, computed internally by 
the California-housed computer. The computation is based on the assumption 
that an average student working an average amount of time on the Strands 
will achieve a one-year's gain (AGP) in one academic year. This is a model 
of assumed student performance and is not based on actual student perfonnance 
in a normative sense. The Stanford Achievement Test, however, reports 
achievement based on normative samples of normal nainly middle-class 
constituents. 

Thus, the bases used to report achievement are different for each measure 
of math achievement and, furthermore, hearing-impairment was not taken into 
account in either measure. Thus the lack of a significant relationship could 
be a function of the measures used to report achievement. 

Another interpretation is that achievement ii\ the Strands may not transfer 
to the paper-and-pencil computational skills required in the Arithmetic 
Computation subtest. That is, gains in AGP are meaningful only in terms of 
the computer structure and do not readily transfer to other situations. The 
available literature in this area does not treat transfer of training. 
Suppes, et. al., (1973) do not report on findings in this area even though 
data similar to those reported here were gathered during their evaluation. In 
addition, the Strands uses a generally analytic approach to improving math 

o 
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skills. The analytic approach could be inappropriate for hearing^iopairerf 
students and could partially account for the non-transference of learning. 

Turning attention to comparisons of CM and non-CAI groups » the 1971- 
72 CAI group appeared to achieve greater than did the non-CAI grotq> 
(Stanford Batteries). The opposite was true for the 1972-73 comparison 
groups. If the 1971-72 trend occurred in the 1972-73 comparisons, one would 
suspect that CAI had an effect on achievement on the Stanford » even though 
most of the comparisons were non-significant. The trend was not maintained, 
however, and we are left with the interpretation that the comparative 
differences were due to random factors. 

The strong significant correlations reported between problems worked 
and AGP gain for both the 1971-72 and 1972-73 groups are within expectations. 
In simple terms, the strong tendency for students working comparatively 
large numbers of problems to show cotq>aratlvely large gains (and vice 
versa) is a logical outcome considering the internally computed means of 
recording achievement on the Strands. 
STRANDS AND IMS ; 

One point to be discussed is the relationship at MSSD between the IMS 
and the supplemental drill and practice Strands. For the 1971-72 group, 
a non-significant relationship was noted between gain on the IMS (in terms 
of units completed) and AGP gain on the Strands; and a questionably 
significant relationship for the 1972-73 group. The 1972-73 group showed a 
significant parametric correlation of .55 between achievement on the IMS and 
on Strands but the non -parametric correlation on the same data proved to be 
non-significant (r^o .224). As noted earlier, the parametric correlation is 
suspected of being spurious. 



There are» however, several considerations that tmist be taken into 
account. The nieans of recording achievement in the IMS and Strands may not 
be compatible. The IMS has no means of reporting achievement other than 
progre»s through the system in terms of units (cells) coi^leted. Here again* 
the lack of significant relationships could be explained as a function of 
the measures used to report achievement. 

Another consideration regards the usage of Strandr. in relationship to 
the IMS at MSSD. Even though a student may be placed in a particular strand 
or level within the Strands program, the IMS and Strands were essentially 
non-coordinated, progransaatically, throughout the two years being reported 
on. This means that a student working on horizontal addition in IMS would 
by change only be working on the horizontal addition Strand or vice versa. 
Similarly, a student experiencing difficulty in fractions would by chance 
only be receiving remedial assistance from the fractions Strand and then 
mexed with problems from other Strands the student was eligible for. 

This programmatic consideration poses serious implications for 
determining the effect the Strands had as a supplimental drill and practice 
program. A strong relationship would not be expected between the two pro- 
grams, inasmuch as they were functioning virtually independently of each 
other. 

The independence of the two programs, however* should not influence the 
relationship between AGP and Stanford gain in achievement. There should be a 
relationship between gain in the Strands and gain on a paper and pencil 
test of computation. The fact that no significant relationships were noted, 
and moreover, that the correlations of greatest magnitude were negative, 
strongly indicates that the use of the Strands program at MSSD be seriously 
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CONCLUSIONS 



The following conclusions are based on the preceding findings and discussion: 

1. Achievement (AGP gain) on the Strmds did not relate significantly to 
achievement on the Stanford math subtests for both the 1971-72 and 1972*^ 
73 groups • 

2. Achievement (AGP gain) on the Strands did not relate significantly to 
cichievement (nusd^ers of units ccmpleted) on IMS in the 1971'-*72 group 
nor In the 1972-73 group (non-paramettlcally). The Strands appear not 
to be amenable to remedlatlve coordlnadon with IMS* 

3* Differences in Stanford math subtest achievement between CAI and non*CAI 
groups for both academic years reported were attributable to uncontrolled 
variables and did not reveal superiority of achievement In either group. 

U. Positive transfer of learning from the Strands to paper and pencil 

computation (achievement) did not occur at MSSD and In two cases showed 
a negative relationship. 

5» The value of the Strands used as a supplemental drill and practice program 
at KSSD cannot be determined because of the lack of programmatic coordination 
between IMS and Strands^ 

RECOMMENDATIONS 



The conclusions drawn from the analyses and findings do not purport to be 
exhaustive t and some Interpretations are subject to further exploration. 
Alternative explanations could be proffered to substantiate or refute the 
conclusions. A well*^designed and implemented evaluation/research effort 
could have provided a more definitive report that conceivably would shed 
light on some of the attendant unanswered questlonn raised In this report. 

It is thereby recommended that: 

1. No further expenditure of funds or effort be directed towards maintenance 
of the CAI until a definitive and exhaustive educatlonal/reseach/evalu- 
atlon design can be implemented to determine the effectiveness of the 
CAI at MSSD. 

2. That no project or undertakings particularly one of the magnitude of the 
CAI» be implemented without proper research » evaluation and design 
consultation and Input. 
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SUGGESTiaNS FOR DEVELOPING QUESTIONNAIRES 

PRtPARiiD BY: NORMA CLARK 
NOVEMBER. 1973 

Teachers often wish to obtain feedback fii>ni students in tiie form of 
opinion or attitude questionnaires. Developing a really good questionnaire 
which validly and reliably meets an assessment objective is a long process. 
Usual Us however* teachers developing a questionnaire for classroom use have 
just one or two objectives in mind and may only plan to use the questionnaire 
once or twice. A complicated process of development and validation in these 
cases is not justified, though it is necessary to follow a few basic princi- 
ples to assure that the results of the questionnaire really meet the 
objectives which the teacher has in mind. 

The following four-step procedure incorporates the basic principles of 
questionnaire design and may be helpful to those who plan to use "home-made'* 
questionnaires in their classroom.*;. The four steps include specification of 
objectives, generation of general questions, selection of relevant formats, 
and writing of items. 

STEP I: SPECIFY YOUR OBJECTIVES 

For most classroom purposes, questionnaires are intended to meet only 
one or two teacher objectives. Before plunging into writing individual items, 
keep in mind exactly how you intend to use the results of the questionnaire. 
For illustrative purposes, let's suppose that the objective of a prospective 
questionnaire is to assist the teacher in deciding which of many available 
social studies films to order for a future social studies unit. Hius in 
this case: The purpose of the questionnaire will be to provide the teacher 
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with information about the interests and preferences of students , 
STEP II: GENERATE GENERAL QUESTIONS 

Once the objectives of the questionnaire are specified » begin to consider 
^^^^ Sonera I kinds of information would meet each objective. For the example 
cited above t these two questions might be relevant: 

^ • Wh , at social studies films have the students liked so far? 

2. What aspects of the social studies films already seen by students 
have thev found most appealing ? 

STEP III: SELECT RELEVVVNT QUESTION FORMATS 

The kinds of information required to meet an objective will determine 
the number and type^ of question formats to be used in a questionnaire. 
An important consideration in selection of formats is the age, ability or 
sophistication of the persons who will be answering the questionnaire. Try 
to select a format which provide5 the kind of information (e,g. evaluative, 
comparative, att itudi nal) , yet can be easily comprehended by the persons 
who must respond to the questions. 

Descriptions of several basic formats and examples of the uses of each 
are provided below: 

" On-ofr' Formats : This format consists of a statement or question to 
which the respondent must select one of two response options, such as yes 
or no, true or false, and agree or disagree. This is pex^aps the simplest, 
most direct of all formats and requires very liLtle sophistication in judge- 
ment on the part of respondents. This very attribute of simplicity does 
however* limit the quality of the information in that the response options 
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do not provide for partial agreements or qualified answers. 

To obtain evaluative information this "of-off" format can be used as in: 

Example 1 : Huckleberry Finn was a good novel . T F 

or for attitudinal information as in: 

Example 2 : Did you like the novel Huckleberry Finn? Y N 
or for comparative information as in: 

Example 3 : Huckleberry Finn was a better novel than the Badge of 

Courage 

Agree Disagree 

Likert or Scaled Formats : This format is similar to the "on-off" 
fonnats, but instead of two responses options, the respoi.uent must select 
from options along a dimension. Typically three, five or seven gradations 
or options are delineated. The use of more than seven options is curobersoae 
to summarize and requires respondents to make very subtle discriminations. 

Response options for the Likert or scaled format can be developed for 
any characteristic which can be dimensional i zed. Common response dimensions 
are Agree - Disagree (e.g. Completely Agree, Somewhat agree, Undecided, 
Somewhat disagree, Completely disagree). Like - Dislike, True - False, and 
Good - Bad. This format requires more sophistication on the part of the 
respondent but has the advantage of providing for gradations in opinion. 
(This is a diffic ilt task for a majority of our students). The Likert or 
scaled format can be employed to provide evaluative information as in; 

Example 4: I think the novel Huckleberry Finn was 

Very Exciting/Pretty Exciting/So-So/Pretty Boring/Very Boring/ 

or for comparative information as in: 

o 
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Example 5: The novel Huckleberry Finn was better than the Badge of 
Co urage . 

Complfrtely Mostly Mostly Completely 

/Agree /Agree /Undecided /Disagree /Disagree / 

or attitudinal information as 1^: 

Example 6 t I find it ea?y to talk with my classmates. 

Completely Mostly Somewhat True Mostly Completely 
/ True / True / Somewhat False/ False / False / 

Multiple Choice Format : The multiple choice format is useful when the 
objective is to determine which of several Ideas » events or items is preferred 
by the respondent. This format is often employed in attitude surveys to 
determine which of several response statements ( i.e . response options) best 
describes the respondent's own feelings. Two examples of uses of this format 
are: 

Example 7 : The best part about the novel Huckleberry Finn was: 

a. it was funny 

b. it was exciting 

c. it was short 

d. it was easy to read 

Example 8 : If your parents told you that you should try to do better in 
school » why do you think they would do that? 

a. because they were grumpy that day 

b. because your grades should be higher 
Ranking Format : The ranking format is useful when the objective is to 

determine respondents order of preference among several alternatives. While 
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Other formats can be used to infer this, the ranking format directly asks 
the respondent to provide the information. The ranking format is a very 
straightforward technique when comparative information is desired. If* 
however, a large array of alternatives Ce»8« more than 10) are to be 
ranked, respondents may have difficulty with the ranking procedure and 
another format, though indirect, would probably be more reliable. 
An example of the ranking format is: 

Example 9 : Please rank (number) the following class activities from 
what you think is most enjoyable (a rank of "1") to least enjoyable (a rank 
of "5"). Place the number of the rank you select on the line for each 
activity. 

a. Playing word games with a group of students 

b. Planning puppet shows 

c. Seeing movies 

(d. Performing in skits 

e. Going on field trips 

(NOTE: We find that in an intended questionnaire for the entire MSSD student 
population, ranking is^ a difficult task). 

STEP IV; WRITE QUESTIONNAIRE ITEMS 

In writing items for opinion or attitude surveys, care should be taken to 
assure that response options are consistent with the question being asked. For 
example, if you ask a question with the stem "How much time do you...." then 
the response options. Very often. Sometimes, and Never are inconsistent. 
Instead, the options might be, A lot. Some, and None in order to be consistent 
with the question. 
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A second important consideration is clarity. A coranon error in writing 
Items is the assumption that the respondent will correctly Infer what is 
intended by one item from a previous item. Try to write each item as if it 
were going to be the only one in the questionnaire. 

A third consideration in questionnaire writing is possible response bias 
on the part of respondents. Response bias is the tendency for a respondent 
to answer questions in a pattern which does not accurately reflect his own 
opinion or attitude. For example many persons tend to answer questions in 
a manner which they consider socially acceptable, or which creates a favorably 
impression. For this reason, try to be objective in your question-writing. 
Do not load the questionnaire with an imbalance of positive or negatively- 
worded items, unless your purpose dictates otherwise. Whenever possible 
assurances should be given that answers will be anonymous or will not affect 
grades, job selection, etc. Do not, however, give false assurances or you 
will create an insurmountable credibility gap. 

Another response tendency is for respondents to select the sms response 
option for each item. Often the option will be a noncommittal or middle of 
the road option. Wh«^never feasible, a careful, though not necessarily detailed, 
explanation of the importance of the questionnaire will usually encourage 
people to respond thoughtfully and honestly. 

Another important aspect of questionnaire writing is the preparation* of 
careful instructions for each group of items with the same question format. 
Do not assume, for example, that they are to circle their selected response 
option - Tell the in. Clear instructions maximize the possibility that all 
respondents will use the same procedures to complete the questionnaire. The 
choice among circling a word, putting an X in a box, checking a blank line, or 
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filling in blanks with words at the end of a sentence (given a list to choose 
from); for Joaf populations, should be made on the basis of the anticipated 
level of sophistication of the target (or intended) group with which the 
questionnaire will be used. 

We hope these suggestions are helpful to you. Once you have developed 
your items, staff of ORE will be happy to assist you in checking over the 
questionnaire that you plan to use. If you encounter difficulties, please 
don't hesitate to contact us. 



UVALUATION MANUAL: A SQIEME FOR COLLBCTING TEACHER GENERATED DATA 
HURINC; FORNLVTIVE EVALUATION PROJtiCTS AT THE MSSl). 



The manual on the following pages arose from a need to systematize 
data collected from participating teachers during evaluation of projects 
undergoing development. The format presented is by no means meant to 
be appropriate for ever>' developmental situation. Some of the techniques 
may prove to be useful in specific settings. 

The ORE has utilized the manual and has found it ver>' helpful. Teachers 
report that it is easy to use and does provide them with information both 
valuable and usable. 
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PARTICIPATING TEAQIER'S 
EVALUATiaN MANUAL 
FOR 



Model ScconJar)' School for the Deaf 



Produced with funds from the U.S. Department of Health, Educati 
and Welfare. P.L. 89-694. 



3S 

INTRODUCTION 

You are about to participate In an evaluation of 
materials for the classroim teacher/ The materials to be 

evaluated are still in a formative stagje* subject to change. 



They have not been previously tested nor revised in a formal 
sense. They are now ready for Pilot Testing in a classroom* 
before further revising and polishing. 

These instructional materials were developed under the 
direction of a person very much like yourself. Now we are 
collertlng data to be used in rewriting and restructuring the 
materials on the basis of use by t<^Achers in various settings. 
Although the information you are being asked to gather may be 
quite different from that which you usually record » remember that 
It is very Important to the further improvements of the materials* 

Please do not copy the materials you are testing. When a 
final version is ready « a set of the materials will be sent to 
your program. 
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You may find that pressures and demands of 
your teaching position may tempt you to spend less 
time in gathering and recording information on 
these materials. If you are so tempted » please 
remember . that you are the sole source of infor- 
mation on the workings of these materials in 
your classroom. This information is vital as only 
a few classrooms are pilot-testing these materials. 
The more information you provide, the more total 
information there will be to work with in the final 
version. 



Ue realize that the materials may not work well with some 
students, and we need to know the details of your experience 
with them. Please, therefore, put your energies into recording 
your criticisms of the materials openly and candidly. 




...ve do appreciate the fact that the present demands upon you 
are very heavy - but the goal is vitally important t 
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RATIONALE ; 

Your participation in the pilot-testing and evaluation of these 
new instructional materials i« vf^vy important. You are being asked: 

1. to determine the success of each learning activity in relation 
to each studetiL. (Can the student perform the cognitive 
tasks?); 

2. to determine what problems arise in using the materials (Are 
the materials suitable for your teaching situation? Do the 
students find them too hard* too easy, boring, etc.?); 

3. to assess affective, cognitive, and psychomotor changes in 
each student's behavior during instruction (What can he do 
when he has completed the materials as compared with what he 
could do before instruction began?). 

WHAT INFORMATION WILL YOU GATHER? 

You and/or your students will be asked to make the following types 
of aitsessments during the evaluation of the instructional materials 
(forms will be provided for you to use): 

1. Subjective evaluation of the success of each activity through 
teacher re po rts , student performance , records , questionnairea . * 

2. Objective evaluation of changes in skills, attitudes and 
knowledge by unit tests , general tests , performance in tasks , 
interviews. 

3. Description of the process and conditions of the instruction by 
specification of the setting , perceptions of students , ratings 
by teachers and students . 



^server reports (by others) may be ad.icd here. 
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USIMG YOUR INFORMATION-GATHt-RING TOOLS 

Booklets : You will have a copy of each instructional booklet that the 
student will use. Please write directly on your booklets. 

Make marginal notes beside each specific activity describing the 
students' reactions and/or your reactions to the activity. lf» for 
example » a student asks you to explain a word in one of the book lets » 
circle that word in your unit copy and note what you did to overcome 
the lack of understanding. Tally other students* difficulties with that 
word» if necessar)'. 

Be frank about whether a particular activity was good, bad or medio- 
cre - and interesting^ boring or blah. 

Remember that criticisms are important, and that the more you write » 
the more helpful you will be. 

Student Folders : Keep all student materials in individual folders, in 
one easily accessible place. 

Do not permit the students to use the materials outside of class; be 
surw the students return the materials at the end of each class period, 
unless specifically indicated by the activity in the b' >klet. 

Be certain each student records his attendance, h . tardiness (if 
any), and the Unit-Activity he worked on for that day. STUDENT DAILY LOGS 
are in individual folders for that purpose. 

You will be given two files, one for WORK IN PROGRESS and one for 
WORK COMPLETED, with an individual folder for each student in each file. 
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A simple rule to remember is to collect everything each day. We 
are asking that all materials be returned to MSSD evaluators when you 
and your students have completed the materials. 

Tests : Each unit begins with a pre-test. Students who meet the criteria 
specified for passing the scored pre-test may move directly to the 
following unit and its pre-test. 

When a student is ready for a unit post-^test» collect all of the 
material he has been working on and put the material in the student's 
WORK COMPLETED file. If the student does not pass the test, file it 
and then recycle him through the materials; collect all of the material 
again; mark them '^second try'' and file them; give him a new copy of the 
post-test Cniark it '^second try**). 

If you find that you must coach on a test you MUST NOT give any hint 
as to the right answer » AND you must note the fact of coaching on the 
back of the student's test with a brief explanation of why the coaching 
was needed, and what was said to help ihe student understand the question. 
Diary Sheets : Start a daily log. This will supplement your entries in 
the individual teacher Unit booklets. 

Note those activities und reactions that you perceive to be a parti- 
cularly unusual and/or unique. 

Note anything which may indicate affective comments^ attitudes, or 
changes in the class. (For example: The class was really "up** today - 
much discussion on this group activity generated; or» ''More kids are help- 
ing each other today than did yesterday.'*) 

Much useful information is gathered when a participating teacher notes 
those things which did not work and his assessments of why they did not 
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work. Your diary sheet should include daily <th.i..:»ents which indicate 
degree of interest expressed by students as to what is happening in class » 
together with any other comments you feel we should consider for final 

* 

revisions. 
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SUMMARY OF t»HAT YQU SHOULD DO DAILY 

These activities should be completed daily: 

— make notes on your copy of student booklets 
--- circle words students are having problems with 

— collect § file all materials from students 

— make sure that students have conqpleted their 
own daily records 

— collect, and ^^ade and record tests (if given) 

— complete daily diary sheets 

— complete activity check list for each activity 
- — complete other evaluation forms as necessary 
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STUDENT DAILY LOG 



Student 
name: 



Date 



Time to Class 



Time Left Class 



What I Did 
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Activity Check List (Sample) 

IP Activity Date 

Additional comments may be made on back 

1. Your rating of this activity (High) 12 3 4 5 (Low) 

2. These materials were used Worth- Revise Revise Worth- 

while Slightly less 



3. Do you feel that the activity supports the objective? 

m 

_ ^ y es n o 

4. Were the teacher directions clear enough? yes no 

5. Maturity Level? Just Right Too Childish Too 

6. Mature. 

6. Vocabulary Level? Just Right Too Easy Too 

diff icult» 

7. Tearher-Provided Material? ^Easy to Get Hard to get, 

but worth it unobtainable. 

8. Student Interest Level? Iligh Moderate ^Indifferent 

^Low Strongly Disliked C an't Rate Because 



Remember to add your comments on the back. 
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Daily Diary Sheet (Sample) 




Thank you vei^ much for your time and effort in helping us 
with this evaluation. 



ERJ.C 
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RKPORT m THE 
FORNtATIVE EVALUATION 

OF THE 
IDS PROJECT: TEXTURE 



WILLI AI-: D. GRANT 
OrrifF OF HEr?:ARCH AND EVALUATION 
DECHiMBER, 1Q73 



PRODUCED WITH f V:;?.'^ I PC!* THE I'..". DE: ART?n-:NT OF ilKALTH, EDUCATION AND W?:LFARE» 
P.L. 89-6?1a. !:0*aT//FF, TKF ■^PTIITor-: OR FOLICTPr. EXPRESSED HEREIN DO NOT NECESr.ARILY 
REFLE'^T TH^"^ C*^ *',,"", • t.*r .'.r."^«.*T;-'-'^ ."^rr tjTr.'.T "^r; ^ ^"r'"rAT''^0;J ANP WELFARE. 
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FOREWORD 



This is a report cf a formative evaluation of the General Art 
TT Unit, Texture • The program v:is developed by Jay Tucker, Content Specia- 
list^ and Jean Fulton, Instructional Design Specialist, under the supervi* 
sion of James Kearney, Coordinator of Curriculum. 

Barbara Petterson, the participative teacher, used the program in 
the art area of the M.S*S.D. and cheerfully put up with seemingly endless 
evaluation tasks. 

Figure 1 is from materials prepared by Jay Tucker. 

Joe Hosenstein and Jim Kearney both pave patient and invaluable 
editorial assistance. 
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ABSTRACT 



A formative evaluation of an in-house developed unit of General 
Art TI, Texture was undertaken. The unit is designed to lead students to 
be ible to describe the surface quality of real objects using six basic 
terms of textures. A se nple group of eight (8) students completed the 
proffram In an average of 9-7 class hours. All students attained 100^ level 
of accuracy on cognitive posttests. The instructional sequence; Student 
Attitudes Toward the Experience; Participative Teacher Reactions; and, Stu- 
d«*nts' Ability to Perform on a Test of Retention of the Cognitive Information 
Learned in the Unit are included in the report. 



BEST MfAttABLE 



Instructional Development And Evaluation 



Tni^lruclionril Pevelorment is a systematic ^ logical process for 
deVeloririfT validated, practical solutions to instructional probloms. 

Model Gecondar:,' School for the Peaf (MSSD) coordinates in- 
struct lonal dr^v^^loriTient efforts through an Instructional Development Sys- 
tem (ir:^). 

Evaluation is an ir^treffal rart of the IDS. Evaluation occurs at 
both fcnaati\'e and summa-vive stages of the IDS process • The words •*fonaa- 
tlve evaluation" are used hr^re to mean evaluation at intermediate stages 
of the rroc'^ss of devt>lor!ne!:t . The results of fomative evaluation serve 
ai? a basis for ir.odi!^/inr the product in its formative otafres. (Gene V, 
Haas. "Tvo renerat l;;>riS of evaluation models.** Paper r>resented at IJobraska 
Tersonnel and luiluii^e Asr,cciat Ion , Lincoln, Nebraska, September, 1968.) 

Kv'iluatlon in this sens^e is not, then^ "pay-off" evaluation. 
Rather, the ^-oal is to rrcduce a statement limited to the "poodness" or 
"badness" ..f rro^iue* i^s^^lf. Tt is an analysis of th^ decree to which 
as?>jned : nt *^rr-* 1 l.^?:.^hir.« of tho .?rnt ''^x^ of the materials, tho knovled^^e 
of the stuie:*/.-^, ar.d the? experieriMal effect of their exposure to the pro- 
duct, hold. The .roa] of r-nch anaJynis, therefore is to provide Information 
to be used -i:^ H i-ai?!,? for modif^'ln*?' the rroduct itself as necessary, in order 
that the rroduct ^^:t*^^r reach it:^ i^tated cb,1e.?ti ves . 

"u!r:-7;a*: I'^e '^vxluationn u;Mjul]y result in determinations for adoption 
or re.loction of i r'trti jular rrnduct. The formative evaluation provides in- 
formation to a deve]orr.ent terjr; tha* stecifically indicates what chanres, if 
?Hiy. are neces^ar;.^ ir. >rder that th--^ rroduct In question m^v be adopted. 

Formative evaluations do not normally yield Judgments of acceptance 
or re^^ectior. of a rrrduct. It H u.^ual]y assumed that the product meets cur- 
ricular ob^^ectlve.^ and is concerned with enhanoini^ the compatibility of the 
rTOi^.rBr. to a rar^! ?':lar . ".udi^nce. 



General Art II And Texture 

r^ne of thf^ products o^ the TDr *^t the MmD Is a series of six 
units which are rart of the sequence vleneral Art I.J # (The 'Elements of Art) 
fiinctions as a rreparatorj* exrerienee leadin^r to offerin/?s of a more sreclfic 
nature. The ^"'^ThH'i.i \^ vwo-fold: 
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!• r^*velor!n/^ vopabulftO" and ten 

art ofc.lects^ and 

2. D<=»ve]ot inr a working facility 
art and principles of desipn. 

The nro*?:rain t exture 01, the subject of 
three (3) ^uch rroiF^rruns planned for the study of 



iinolo^;ies as they 
iid evaluation of 

with elements of 

this report t Is the first of 
texture. 



Texture 



Tills unit of texture has as its stated ob.^ectives: 

Terminal Perfomange Ob.lectiye ; 

ulven various real ob,1ects, materials , <?tc., the student 
will d^ronstrate his/her underslandinf of six basic tex- 
tures by usinR them to describe the surface qualities of 
ob.^eetr^ correctly* 

Enabling Oljectives i 

The student will reco^^nize two methods (visual and tactile) 
used to learn about texture, and name them correctly* 

Wien asked to describe the surface quality of a given object, 
*h*^ :;tudent will describe the ciuality of the texture of the 
olject, rather than the auallties of color, chape, etc. 

livt^n ob.^ects which Illustrate the basic textures, the stu- 
dent will write, 3ign* and finfrerspell each texture correctly, 
describing a surface with more than one texture, if appropriate* 

•liven a list of sr-^cific textures, the student will find and 
rhotOf-rarh ::)b.1ects to illustrate the texture, and will label 
each rhotoitrarh usinr the correct texture name* 

liven photOftrai>hct cT objects with "highlightc*' marked * the 
student will label the "hirhli^^hts" correctly. 



The Instructional f^e<^uence 



The sequence of instruction for the texture package consists of a pre- 
test, one il) self-raced basic activities, and a rosttest. Ten (10) of th^^ bislc 



I 




1 



KSr COPY AVJUU8II 



52 








r 
Is 










• TT 
5iA 

















/ o 




P «; « ■ 




Tf • 

;9 a lil 

M »^ 


V 




CO 
01 



4* 

u 
d 

O 



01 

-a i-* 

CO 1^ 
4» 

o 



4> 
01 



9 



o 

01 
0> 

o 

4^ 

01 
0> 



*r9 

t 



'01 



4^ 

0) 

§o> 
4> 

C 01 
01 01 
Q CQ 



4» 
01 
01 



4» 



CM 



4^ 



2 

i 



u 
o 

4* 
O 

2 

4> 

«9 
U 



&i CM 



^ 61 

01 Q 

01 r 
o 



iA 
01 

4^ 

o 

& 

Is) 
O 

4» 

O 

•a 

t 

O 
4> 



O 
Pi 

0) 

4> 

C/1 
01 



4* 

4^» 

0) 



o 



4> 



01 

CO 
0> 
H 



01 



3 ^ 



4> 

c 

0> 

I 

01 
0> 



4* 



53 



BEST COPY AVAiLADLE 




ERIC 



54 



;i ••.:•.!' aro ri'cor.rnnio.i by i^uvplemental (branching) activities which rro- 
i r. • ! : r- * ! ••• " 'h i.* * .'tudontn roquirinr it. 

Tl:o ::t«uit'rit '-r-^rir-edc .'it his own rate through the program. At 
srt?o:f Ic roir.ii? jdont.:'- who f»n<.'ount<i?r rep<>ated difficulties in understandinf' 
t.ht? vv">ncerti' aro dire'^*<:'d to or.e-to-one teacher-student tuition. 

J't udor.T,."^ !'ir£^t. ^ake a rretest and then, if they do not meet the 
i*rl* ^r"n '*ov rn',.". inr the vretest, proceed through the Sequence of activities. 

Ki-nr-^ illat'tratcii the Hvauence cf activities and a brief description of each. 



'nc»^r* rif'v.ro 1 at out h«r«:- 



TJio s-t.ucient i.i presented with multi-modal approaches. The banic device 
i.- th-? rrir.tv i i nstru ---ria: t^^ckare. i acka^res contain exercises in both visual 
ar.i *acilo rricdo-. 

A r::cr.:irr for student sel f-test.inft is provided throui^h use of a nechani- 
I'Oc-ronso -n':::: ! t;-^. TJv.^ fee-ilack device used for this prop;rajn was produced 
•.".*'"2:.T.o.i;a Ir.orrr ora" ci cf Y^lz Alto, California. The device requires u?o of an 
!*?!•: .^:'.rd, vh:.-!L rv.TnrJc runoh<=»d student responses. The functioninf: of the device 

Iho.*.. ttic .^'.ud-nt rrf* vented fro~ responding: to subsequent questions 
'.;r.*l: tl"."" rirht answor ha.' been obtained for the question or item he is working 
o-.. {"'"7?:: Ir-.TrediM Tnr'^n orat'^d is no lonffor in existence: thus, an alternative 
tc ti'dr particular rcproiu"' d^-vice will be conoiderei.) 

^eal c:.lectr., rrerared and introduced systematically so that learning 
about textures la "ontrcll'^d, are used by the at.udents as learninr; aids. The 
studfir.t', for exfurxle, is s^pvliod with three (3) cubes which clearly illustrate 
difference? in only one (l) aspect of texture (i.e. hardness) while controlling 
the others (rr.urhr.fri and nhlnlness). 

"."urrler.-ntal" r'-'adinr VooKlets (prerared specifically for the program), 
several 3 rrxi r.iieni filr. loors and a l6 inn captioned film comprise the renaining 
materials u::-d in the prorram. Captionii for the commercially-available narrated 
16 rr. rilr. were prepared by the lT<i' specialist and the content specialist, usinp: 
a 3jid"-cync technique. 

Production dela.vs did not allow for use of all of the required films 
bv the students. Thiereforc, to-be-filmed information was presented "live", 
with strict adherance to the film script and information was presented without 
rr-j.:*- r. ('.:, -nr:. th- .•^l*:.^- r.annor *hit t film would be viewed). Th^ livo 
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Ai^ part of a final activity studentc are asked to use a polaroid 
iV^ienx to photoecraph objects which clearly illusti^ate the six (6) textures 
tau.'^ht in thic unit. The students are also asked to photOfrraph and identif:/- 
tvo n-?v textures uzinr descriptors of their own choosing. The pictures are 
t^en assembled into a labeled scrapbook compiled by the student, ^'ach stu- 
ienr then produces a colla^'ed cover for their individual books. 



Pomat.i VP vnluation 



Torr.ative evaluation is evaluation at intermediate stages of a pro- 
rran. A formative evaluation program yields data of use and importance to 
the development teajn in their efforts to modify the program as indicated and 
thus do not necessarily produce result- of major^ generalizable educational 
i report . 

Evaluation programs resi , in general, should indicate that: 

1. The students have learned and are learning using 
the materials in question. 

2. There are no residual negative student reactions 
to the program. 

3. f.tudents work constructively toward the completion 
of assirned tasks. 

The sLudent develops an ability to express, in a 
medium appropriate to the context, what he has 
learned. 

5. The atmosphere of openness and interaction during 
class tine has been advanced. 

This report will address itself to th^ above five (5) points. 

:>!ETHOD 

The 7ample 

The profile of the eight (8) students who were enrolled for th^- 
General Art IT course is presented in table 1. The Group 



Insert Table 1 above here 
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1. Cv^r.r.i deration was srivcn to the diversity oV 
wrbal aMlities apparent, in the rroup. 

r. rroblem:-^ attendent In ro.vt.ructurini>^ of the 
clac.? i^chiMulfr?;? of th^ Iridividual ntudenta 
c^ould be avoided • (Recau^^e of the small 
r-»tud»^rr, population of ihe any chan/^e 

in an indi.^idual student 'i? schedules i^an 
radic^ully affect many other classeiO. 

Class .^ci.edult^ 



"lass att.enda!iCo» wa.-= for one (1) hour* three (3) tines a week, in 
^•rou*>r of atout five (^) .'indents each. .Characteristics of the schedule w<?re 
such that the daily cla:7? corxcsLvion was /arled; that Is^ each student did 
not r.e^j?t vi^ii *'hf sar.e rrour daily. Inasr.uch as the rrorraiii on texture wat- 
developed for Individual ure. i.he daily confi^ruration of the clans did not 
present r:*^.^atLve !*act::^r3 for cor^^^viderat ior. 

TretestG /vnd -^or^ttenti^ 



V\\<y ti-xt uro uni* ir.crrr ^rat ^ j u r-r-F^test and a posttest. Tliese yolld 
data cf the .^••uden**.^ cOfirnlMvf* exver lt^r:<res • 7i\v tests require the studentr. 
to deterr.in-? the tex*urep :f ob.1ec*T and write dovn the nair.es of those tcfxtures, 
Tne tt^st al2o r*o/airer thv- ^'tudent t.: to! 2 the inrtructor the names of textures 
of ob/ec's. 7:;*? ? r..-* ru?*" r rec-.-rd/. * :v /t-.i-j^^-nts r-rhval responses. 

Hecord Keeping 



The particirat i np' tr-acher rai retained a writtc-n daily comnientar:r on 
the in-class vorkinrs of the r'Torr'}^. in h'^r own ^^opy of the students' instruc- 
tional materials* These nctec allrw the teacher to recall problems encountered 
within the relevant cr-i.^^ext of the pr:rr:c For example^ words for which stu- 
d'^nt^ asked help to '.;:.dor.'tand were .?irclod In the teacher's copy of the mate- 
rials. This prives ir.ror^ant i nforr.v* J on of st.-'rcific contextual difficulties in- 
herent in the prepar^^d rrijitod mat t-rlal:! . (A student n^iy understand the r.oaninp- 
of a word in one con*^:<t bu* .lOt r'^-corni ♦'he sane word when encounter*-d In a 
different context?. Th.^ teacher* :> ?-^ry ar-d ^orjr.ents were turned over to the 
e valuator. 

Ail the instructional materials '.^c.\S'jn<Ml l-y the i^tudentr. were retained. 
The condition of the ni+orialn (wenr and "Lear) cervc as indicators of ctudentr. • 
use of the.-^^e itenr. A booklet which is worn and writ'^en in nay tell more ibout 
I'^C ir^: *r.ar: vh:"':, ' •*l'":r: \::\ *r«*"i --^ 1 . ' • -r ''-n j; M/' , frf course^ • ■'. ^^h** 
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vorK nabits of the student. )• 
I'tu.ient Intervievc 



Eat^h of the participants wac interviewed when he or she complotod 
activity ir^even^'^on (l7). Verbatium transciripts were obtained from video- trxred 
ro.?:r4in^s of tho interviev sessions. 1 :e interviews were structured to deter- 
r;1:.-' If students: (a) Would verbally convey acquired cognitive knowledge, and 
(i ) ?:xrro;-i=?ed tiny affective changes as a result of their experiences with th? 



rrcr^ran. 
Cr.---^rvat ion 



The Instructional Design Specialist and the Content Specialist al- 
ternated, in dail;/ direct observation of the rro^ram in operation. In general ^ 
obi^erx'^er^ vpre concerned with mechanical problems of implementing the program. 
The obs^*rvati orrv were totally passive: observers in no way intervened in the 
crerationis cf tho class. 



RE;.»ULTS 



^r?tes ts nnd ro ^^ttests 

Th<^ i^tuder.*.:^/ rretest-tc-posttest p-ains are rresented in Table 2. 
Tosttect scor^3 are not reported 'is all tiludents attained a lOOf? level of accu- 
racy cn the nostte:it- !:cr.e of the students attained criteria on the pretest. 
The criteria (rcuarhly 86^0 which wore established for both the pretest and the 
post test vere: 

Quer'.tion 1 100?- 

Question ? 100^ 

Ouention 3 10 of 12 correct 

-iuej-tior* I 10 cf IP cr^rrect 



Insert Table 2 about hore 



Use Of Alternate Activities 



Student rerforr.ance with the material was collected and analyzed to 
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?8 Possiblf- rretest-rosttent 

number 5 Percent 

.'■rtT'I-'r.": Correc?t Torre ct 



1 ^. IR'? 82 

^ 18 82 

? 6 21 79 

I 2 7 93 

5 8 29 71 

£ 3 11 89 

7 k Ih 86 

3 11 89 



!.:e.\:i ^.f' ifc.i''- -3.9'' ^'Aiii 
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Table 3. UTILIZATtON OF ALTERNATE ACTIVITIES BY STUDENTS IN THE PILOT GROUP 



Alternate Activities Used 

da 
none 

Ua and 9a 

la 

10a 

none 

none 

none 



Total Alternate Activities Used 

Total Duplications of Use 0 

Total Alternate Activities Used 
Requiring One-to-One In- 
struction 0 



1 

2 

jt 

6 
7 
8 
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.itMt*rr:in»* t!;t^ fxtont to which -jtudontc found it n«^cor>nriry to utili;-.- Mv^ 



iM ui*v:!.- ritivly !'o\UKi It suH'vcj;-Hry to rr,fjk(^ Ui^f* of the altt-^rnrito net i vi t . 
rion»' 'lit <»rnn.ttN^ riv^uirod tho orif to-on^^ inrlructional modo, nnd there 

vere no duvl 1 critiotin in lu^e. 



Tht.' verl"\t nir: tranBcrrirt:^ of the video-tap^d i nt»*rvi -^wi^ ^re lonrthy, 
*ir,d are nrrondfd Miic nn^ort, tor<^thcr with a covy of the J nterviever's 
; r::'truct f on.-^. Anrtly.^t-: of the intMrvI:-w;^ in^-lude both verbal and nc«n-verbnl 
rer>r.\nc-oB. rjon-verbal re^ronses are thoce which tnf\v inferred from lody 
r.overr.erits , facial exrrenni on, etc. 

\V>^.en isked r.ane two (?) vo^vi* to learn about texture, only one (l) 
of : eir-ht ( ?) *-tudentn anpwer^'d the 'juef:tion the firrt tin*^ it was asked. 
Witli ;iore rror.ntinr, only one other student was able to answer th*^ question 
with th-^ nix it) students who did not answer the viucstion, irir.odJ ately , the 
4u^*:2*ir!i wa3 reworded and waa reintroduced 't* a later roint durir;r the inter- 
view. '\lier; the .^tudenta were confronted with the reworded qu'"*r.tion, all six 
(6) rurrllel ?i!.:=wer.^ that were correct. 

••our (-) 3tudent/^ were ai";ked to nar.e another t»^rn for "texture". 
Althouf'h tu^no -.'oul i v-^rbal:::e a recronre, th^-^ro acknovledred that they did 
recornise the t'^rrr. ".'^urfaee luality" wh^-n th^' ^-rri wan rrovid'-^d by the in- 
terviewer. 

The c^udent-^ were rlv^-r. a variety of ob.lects (keyr. ^ rubber band, etc.) 
sand asked to verbally id-»n^ify th** texturer, of th^ nb,^eetn. All .students identi- 
fied correct t^^xture nanes f<:'r -h^' ob.V^cts. ;"orie of the rer.T'on:-ei^ were elicited 
uron various d-^m-^ei^ of rror.rtinr^. T^l•"- int»^nnity of this rromrtinp wac not hirh 
enouf'-h to be ."or.r^ : ijered sir:.: f i c-tnt.. T^.'^r*' vaf> sufficient indication that all 
the students knew th«' required cognitive information. 

''^ne ;'i»*n: f icant nr.n-verbal '»v'\^;* occured durliar a t*haii«' of th«/ int^-r- 
viewn. When riv*-^:: a rubber lar. J, --ach of the *^ir^ht (8) 5t ud^ntn handled and 
r.tretchei it in a r.anner (aloo tn'!d-r.t f-jcial exrresi^ion) indicatlnr that 
♦hey were unsure ao whether to conr.en^ or. ^.hv ^'la^ticity of th*^ material. (Klar.- 
tic'ity or Tlasticity were not .-neluded i?i thi.' unit ar. t^-^rmF to be learned), (^nt* 
(1) student did respond with "rtretcb»y" *'-xture *-rr, but th-n n.dieated tlint 

r,he wac "only tearin--". Tlio uncertainty nf th^ .^.tudenti- antl r.trvM.ehinr t.h*' l-and, 
howi^ver, are cl-^'arly evident, in all tated I ntervi^^w^ . 
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WJu.^ri v-juv*.^! ioned about reactions to the pj^media response? machino* 
.-^r.-,-* {\) '=^xrrof.5ed hnvinr hid Initial difficulty in usinr it. 

7::-' : ?• I - Wk' : V'»:*c*o:nf t r.»* Sfit Isfar^t. ion of the ntudent. All 

^'f *h-* i'*Md-riti' oMrP'^i'ivi tt.^r/itiv-^ n*HctIoni5 to usin^? this mode of record- 
ing r^^rvcurt\'' . Tt.^ /tudcnt exrrf'S.-^ed any difficulty in compreh<*ndinr the 
r^^ndin..* lovr>l/. c*' t::?^ ncMvity hooklots?. Pour {U) students, when aisked, 
re^.rr-^r.d^^d Mi'i* • ::'\v '\.vi;!ul *"he l ookiot? vor^; easy to read, 

.':x (t ) . * .-.-^ i*rom r- hM-i had rerBonal experience with a camera 
hof-. r-* ii:-;:.^* ^r.-.- !t. * t'-xtur^" rrorrar.. .'tudents who were referred to an 
'i^^♦:vi^v io vl'lvr:. ^.-xvlainr" liow *.o ut5^^ thf polaroid camera found that 

Th- ot:l.v ti^r.f^tiv^-* reaction to the art class was expressed by one 
(^^ /t;I'-*r.* vhe ;'ia*,ed *.ha* the use of I.T. 's (meanin^^ written Instructional 
• !i •rrt..^-'.' vi.: **r-ot 'i?-t**. All other re?ionses indicated positive affective 



>. -iJdltlcr "irs thf successful assemblinf? of pictures of exainples 
:::e -6^ l^^'irr.^i "■••x^uror^ * t::^^ r.^udents were askt^d to rhotorrarh and 
r.-ir.o tw.-' ' '*::ev** ***x*ur-*s. The 1 -"*rini^ chosen by those who responded in« 
cludt-: :-urr:!V, :>.:idy, ^u22y , "harr, I ri^ikly, and Bushy. 



TV.* '^'r.*^ r-'*T\:r'=^d t>r .'t id<^r/r' ^o cor.rlete the various phases of 



Th^ rivera^*** tlrr// r*.^:::;roi ir airr.r^rt 10 hcurc-; the clowest student comrlet'-vi hi 
\':t*}: in i? !;r'ir/; rW.'*^^*, In sever;. 



TJ:t:- 'tt^on.r* var rr:adi»> ^ :b?terr.i!:t: hew iruch cognitive information the 
ctu'ler;*.^ rr't'iln.'l -^vor tlrrie. Tvn v-^'^kr after the last student completod tho 
rrograr., 'il^. :*f:ient.--. v^r-^ riv^r: tho r r^ter:t a/?aln. Table 5 dicrlaj/s the re- 
r-ulti5 ::)f this te.'*ir;;*. ll^\o that after avf*ra^re lapse of 35 dfij/s , the stu- 
dents i^'^ored bet*^>r 'hin yl^ eorr^'-ct on retained coprnitive information. 
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Tablo .'TUDETIT rCORF'r ori TK^T FOR PETEimON OF COaKITTVE KNOWLEDGE 



Score On Ttftent; on ?est 

L^pse in Calendar Number f ercent 

V'xrz since FoBttest Correct Correct 



.1 


52 Days 


23 


82^ 






28 


]00 


3 




26 


93 






?6 


93 






?U 


86 


6 




28 


3 00 


7 




25 


89 


5 


or. 


25 


89 



^n^A:^ 35.3 ra,vs 25.6 91. Of? 
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VnO*^^r. kert iy the r^irt ! rirat inr: terichor rolal-^fi rrimarily to 
swv**^^^''-^-?- ^or rrechihical changes in the rrorrfun and those hsve been 
i'.ubmlt ttM to t)it- oj-r.tt.'iit crocialist and fhe TDH 3reciali£t workinr on the 
prcA•r^'^^:. P-^ac^tlonn of thf? rarticinatini^ teacher made at the eonclucicn '^f 
the rrof^nr; rire ^-^xt racted and presented below in the chronolorical order 
they arr^^'irod^ 

A. Tlio rr-^^ent 'ind post test {both the r.airie) test well and were easy 
♦'^ 'ulr:/: nil'. ■ or. 

R. Tho -^f th-^ word "introduction** ic questionable ~ some of the 
ntude\v^r: did not r^een to understand it. (However^ this does not 
r?eer to interfere with student progress otherwise). 

C. Because the I^^Tiedla nachinec have becorne obsolete, the **How To 
Une a r:rn;edia'* booklets should be eliminat«*d. The students loved 
to **pla;/* with ther. so its use is not in question. However, it 
war iiffieult for the instructor to check each quer^ion with each 
student to be sure that only the correct answer whs punched. One 
ntudent (student 6) said h^ had all correct answers, on first 
attempts t yet several punches for items showed on his card- 

With the removal of the Dymedia sy?:tem, it should bo quite simple 
to convert to the conventional format of "circle the correct answer** 
activity, or to find a replacement devlct- that offers immediacy 
7f f-*edback. 

I'. Activ:\v rar^i- ? and 3, (feelinr other reople and objects vit'^ 
eyes closed t? er.rhasi2-=» different ^-extures) should bo eliminated. 
Tt was ver;/ taxini? on the inntnctor and the kids thoup-ht it silly. 

E. Activities ^1^* and #15 F^^^r.ed to take forev-r, but turiK^d o\it wei: 
for the studentr. and did t*"?a^r; ther. hew *o us*^ the Tolaroid camora. 
IV. not cure if other schools will have th«r, available (budretin?:) 
it io a ffood activity but needs more brain ^t^rming. At an.v rate, 
consideration of removal of the flashbulb portion shculd le riven. 
Chear old carr.eran never worked r rorerly and ^^uf^h film and flash 
material was th^^refor^ wast'^^d. T sent evor:r'one out-of-drvr;- with 
no flash to <^llrJnate the problem. 

F. Activity ^16 also took quite a bit of time, but the students on.^oyed 
it and were most impressed with th'^^Ir cwn r'^sults. 

^. In ^reneral, entire racka<=:e was "rood" and showed loth immediit'-^ 
and lasting? results with the students. They all seem to en.loy learn- 
infT. 
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Discussion 



Tho oi:^ht (8) students in this sample exhibited positive co^.iii- 
t.ive crowth as neat^ured by an analj'^sis of the pretests and posttests. The 
tosts show a near. *:ain of 83. 9?? In number of correct responses. It mi^ht 
appear that limited interpretation should be made of this particular sta- 
ti.^:;tic ar- the- pror:ran was dosi^!:ned to teach a limited number of closely 
related term^?. A nirih level of success mipht thutt be expected* However^ 
the 5ix (6) tt-nns (hard, soft, smooth, rough, shiny, matte) are to be used 
in eon^oxt. assessed both visually and tactually, and subsequently reported* 
This rack l3 more '^omrlex than would be initially apparent. 

The students clearly demonstrated by the retention testing that 
they had retained the information required by the proRrajn, Admittedly, as 
abov*^, there was a limited rjomber cf closely related concerts presented in 
tht* rrc^Tram. Tiio i7cmriexlty of identifying terms In various contexts , 
with multiple'* assessment and reportinp' rrocedures, however, significantly 
ir.rinre? on over reliance- jn^on tMs rarnimoniously-stated limitation. 

Die studer.ts sampled had previously used a similar prop;ram. Line . 
This prior -=?xrc3t;r'> ra;/ account for a rortion of the lack of difficulty the 
particrirants encountered in completing the program. Notations made by the 
particis>!it in*^ teacher indicate that students had no difficulties with the 
languar--? iev-c^l cf th-^* printed portions of the program. The only word which 
?ffered *iny rr:"'bl*^rri wa? the word **Brail]p*\ and that problem was easily 
C'Vereor.-^. 

'^no •:r!dicat:.r of th^^ la k of lanprua/re /reading problems is that 
the student.? convl-t»^d tho readin*? po tion of the prop-ram in approximately 
the same time ('..tbTe i^), d^^.^ritp a vido range of reading abilities (Table 1.) 

Thf earo vi^.h which tho students proceeded throu^'h the program is 
further verified by the Infrequent Mi^e of alternate activities (Table 3* ) 
Only four (^) studentn used any al-..»-rnate activities. 

Th'^ use of total commuru cation as a language medium means that much 
■ . :"ormati'.^n is cor.v^y-^d through brd.v r^iovement, facial expression, etc. Tklll 

■ required in the int^-^rprotation of thot>? communication aspects in order 
tr.a* their ^rue meanin^r ma,v be di.^. corned. Tn order to .ludge the unstated 
attitudes of the stuients the videotares were reviewed by hearing and hearing 
impaired reorle ^Killed In the lansruage of si/rns and finger snellinf. The 
non-verbal communication of the students, in the opinion of the tay** inter- 
preters, clearly evidences their very ronitive affecting attitude toward the 
class experience* in texture . 

The discr^^rancy between performance on the written test and per- 
fcrr.ar.?-* In tr.o rvi^vr ma;/ rnr*:!any iu'^ to '♦'h^' intervl '^wer'f? in- 
ability to tally convey questions in a verbal mode understandable to the 
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I'tudont;- . Th^ iifft^ronce na^v also be an indication of lack of traiu? f^- r, 
by the learner, from a written medium t-o verbalisation. In any '^v^nt, 
this area offers opportunity for future study • 
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T}^* !*lv'-* v-.ivr'Ore:^ of ?*orrna* ive evaluation were satisfied: 

!• /*>:r}cr.ti^ did learn with the materials. 

/tuJ'M.lr, ^^xpressed positive reactions to the 
rrof^r'iT.. 

r!-;d--^nt-^ vorKed constructively toward the 
car.rletion of assirned tasks. 

li. T\\e students did dev<»lop «in ability to express 
what van learned. 



r 



An atr.o^rher^ cT openness and interaction during 
the clasi' *:ime was advanced. 

'hanfTo.- a.^ ?a^?!rc.^sted oy the participating; teacher have been sub- 
r.itted for i ncorr era*. ion as a revision of the pro^rrrun. The use of paper 
and pencil rerrjn.-e r:od^s, I:: iieu of the resronse machine, may be reliable 
althou^rh not ncresourily dvsiraMe. If used, self-scorin^r answer paper 
oh-.^uli be ^r.rloyed. 

Tr:o •=^at:^ with whicii .students encountt^red the materials ^ taking into 
account th<^ larr^ srr^^^td of their achievement test scores, indicates that a 
r!ore rrecii^o do*emin.'tt " on tarr^t population should be made, i.e., would 
^i'-^TJ t'-.^-tir.r trv- ^cxture unit a* an e?lementary lovel be feasible and d^^ 
siraM-^? ror.e of the :Jt;;,ien*s* achiev^**ment scores (Table ?.) are similar in 
l«=^ve I t c. t hc:^e c f o 1 *\'r. "*r.'^ 'i rv r '^hool :t ^ udent r . 



It 13 the r»>cor!-tit:*ndation of the TI)1' tenm that, upon completion of 
the required chanr^^n, and uron pr'^r^irat ion of suffici<»nt materials, the office 
^-^f Research and Evaluation .:hculd fi-.^ld ^-.est this prorrom at an off-campus site. 
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Instructions For Interviews 



The purpose of the interviews is to determine if students (a) can 
verbally convey acquired cognitive knowledge, and (b) ejcpress emy obvious 
affective changes as a result of their experiences in the program. 

Prompting should occur only when it is evident that the student 
will not spontaneous generate further response. A delay of 5-T seconds for 
a cognitive recall item before prompting is usually sufficient* 

The interview question sequence as originally conceived is on the 
following page* After consultation '-ith the developing team^ a new form was 
prepared. It was this second form which was used with the students. 
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GTUDENT 
DATE 



INTERVIEW 



Af-K THlu"^r vOliB:^?^-)!:^ OF EACH STUDENT. VIDEO-TAPE THE RESPONCES. 
IF THE RK^roN.^Ki^ DO NOT SEEM TO BE CO^^LETE TO YOUR SATISFACTION, USE PROBE 
quest: cue Oy the TV?E: "that's IKTERECTING; CAN YOU TELL ME MORE?" DURING 
THE IWTKKVihW 'JIVE liC HIT.' AS TO YOUR REACTION TO RESPONSES NOR INDICATION 
AS TC THE RI-1HTNEi?r OR WROKi}NESS OF THE RESPONSE. AT THE CONCLUSION OF T'lE 
TAJ^rriG, TM.'CHIBH THE OUEl'TTON AND RELATED RESPONSES. 



1, What ill you like best when you learned about surface quality? 



2. What thinars didn't you like when you learned about surface quality? 



3. Do you remember if the booklets about surface quality were hard to read? 



1*. T-^li rr.e vhat y:>u learned about surface quality. 



5. Do you like art clas^? 



6. If a:iDther studen*. a^kea you, "Whnt dees surface quality mefin?" what would 
you tell that student? 
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TNTKRVTKW i^CHKDULK 



ART—TEXTURE 



Ask these questions of each student. Video-tape the respons^^s. 
If the responses do not seem to be complete to your sat isf action » use 
careful rrobe questions. During? the interview give no hint as to your 
react iv-^n ro responses nor indication as to the riffhtness or wron^mess of 
the response. At the conclusion of the tapin^^ transcribe the questions 
as used and the related responses. 

Be^rin with a Gtator.ont to nut the discussion into context such as: 

**You h-ive Just finished an art course called "texture**. 

And then continue 



? Car. you tell rr.e tvc wt;/s to learn about texture? 

(Fxrected response — visual and tactile or* touching and seeins) 
? -an yc:u tell r.e ano*:her n-ur.*? for texture? 

(Exrected ro.^ronse— surface quality) 
? iiero iz 'x:\ ol\1oct. Can you toll me ♦h'^ texture of it? 
? Can you tell re anything that you ill r-.-^t like alout art ^la.^^. 
^ V,>r^» tho Vo k.^ .'s) *hat y :\i urod hard *c read? 
? Did you like t:. use the ^aneraV 
? Did you like to use the I^/medla rvachine? 

? If another stud^^nt asks you, "What does "texture** mear/*, what wruii yo 
tell ther;V 
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Tare Location • 000-1^0 



? \^*iu t.-. !i ro t.vo vnj'?^ to If^arn about texture? 



' ivo 'inv-^th^^r til in.-*. 

r:v> another nar:e for texture? 



* ft . tff 



•in. 



ci; 
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• . r^.?r:,*r:;^..r t hnt you r«Tid i-umt- b;^'-^K?: Wert* tl)- I -.'h:* hnrl * 



1'. KnryV 



?rr.-- h'lr^l quest lonn. .llkt' iit-r** ft rh-^^urt^ vh-i^ dc-*-:; Icnk lik- f ; tt!*u;ons) 



A i." !♦ '.^iry use or hard? 



!.\^-?r;i"-r, you could read a bock to r.how you h >v ' 

rcr; hcv, it war> hard to r-?* ^ r!'T*,ur»* (th»\v w- r- ) I'tvV. or 



:.: i y .--et. all t.he ri^tht pi ur-.?? 

"ir^' 'til ri^rh*, somo ur**..., rr.or:* -ir*? all rir^fi'. A -ir** w»v :.r- 
i •^•.ir- T run tr.vm in Mu* r.-rrar ioi-k. 



fr.-i' 'js-ou** the d^vn^^dia iriHi-hir.e* DM y''>u llk*^ 



; /. • • ' ■ ' t ut . } i * } ^ '? k ^y 
• /"r.. r/x'T.t'^'r 1^.0*? 



[ A I, 



Kro 



ar.v*f.::.:* \::at y- 'i 11 1: 



•■^r c^^-uj-'r.t corner 'ir i •ri!k;^ vl ' 
! -^"k :'"*r a rrr,oo*;i ?urra-", a:: 1 /r.ir.y 'jr.'J 



. -r li' : 



rd 



!..•- ar. 1 :*^'*l?r.r. 



,r ♦-:ni'*h! rirV 



- (a 



.•an.-* ; 



< ' Ik" ^ f)^ *,a.^.iu' 
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Octotier 3, 1973 

Tarf* Location • 'i%^hhO 

Interviewer - W, Grant 



V Ar'» ritilphed your clasF about texture or are you almost finished? 
f* nlrsr^' . ! ^cn •rikhu^ r lectures now. 

Vtr: y^^ •'^'"I r.c two viys th^t ycu cat: learn about texture? 

• L-v- yo'i kr.rv two w%'s to l*^Hrn about texture? 
A .''-in--; 

• t"!-m"I-. best con MByuBu 

■"ur. v^^u tho texture of that? 9eraser) 



A ( 1 ! V ^ i - .V \ . r; . 1 - r / *^ ar* i tr.e C 

: \r;it r.- yj ;. W};rir 1? y -^u look for to know if so^ethinr Is shiny' 



Vfr. 'I* i . * / ?i i r.y • ^. : ! . f-r h fiv * ' 



A : r). 



^^^^.at -tr- *• ( rubber V 'ir.si ) 

• V . u • • • 
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yon twir*. It.. 
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a;.;.*. 

M i y ;u Know how ♦ *hv c'ir.vru : • rV r*^*. 

!;t*ver 'is-vi '!.•• ■I)'." • 

. ' ' • ■ • 



or a lonr tir/*. 

yv:^*; t^-^rjcij^ r ^K'i* you ir ri 

And vK^t -io'^^ t.he t^-Hoh-r 



Octobe^r 11^ 1973 



Hiv- y t*!r:Inhe«l your t^'^M^r^ "Texture" 

•nr. y ^'1 rf» *vn vnyr; to learn about texture? 

?vr wiy.- * / l*"xrr*. nbout ♦^xture? 

••ir. y r;*^ -irxc^her n!ir*<* for texture? 

?^ •a.-h - y.:u ;:;Ty: 

7Kh*V- r/ir.e of r texture. ^^^$7" 

C5i:i y i'U ino^n-^r nnn*> for t«=*xture? 

I.\ y rer:^rbf»r th*=* nrune "Surface Duality"? 
rn. . rne xtur^ of thati (eraser) 



.- * *^ 



V:.-.*, V"v,* -t; ^^*r •.haf. (rubber band) 
-a ;* * : (Key} 



:"^v 1 y^u knov if ;?OTnetbinfr Is shiny? 
fT ir:./ r>y/. ; r. - li^h* (;;i;r'V.- .>n key) 

• ;rfi- • 

A*":.*!' i; y l: k fr^r ' :f ?one*hinft ir> nhlny! 

/ \ 



ra 

PSI COPY AVAamE 



A K f'A'-i*'!. I .-ttirt^vi Art I th.curhl i\ vac -jill cir-ivii.r, r:'rw : f'i?. 1 V? -ir ! 

Kr.rv }.:>v boforo 
; vrf> you loirr. that bcTor^^; 



; : : i you tKem il] rirl.ti 

.t' 'c^-tru^r cituder.* ^nk v:»u vh'tt vorci *'^_-\v-*. ur*^'* ry-'f 



r-'^-'-r -r you runhod th»- V'M*Vonc, vuo vJ/t* '•''li-y to 
H'lr'd. ! il in'r know hov» 



/v^inr or tca^hinr. 
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Tape Location - kkO^'jO'^ 
Interviewer - W, Gr.*int 



r*in y.^u T.'^ t.vo v^y^ to learn about texture? 



Do ;/cu knrv ail t!:<? texture^?? 



n • 1 X • 



Yt-^r^ vh-i* t^*^ tf^x^ure of that (eraser) 



: And: 



A Hard 



BEST COPY m\um 



V li'.v.r ^^-.if. (rubber band) 



* r:*r r.r^.-:* of texture? 



anil CT.:::^th. 



W:.-t* 'ir.:*;' ^hat^ (kovs) 



.M ..if :. 



Ar.i 



rind rou'h. 



Vc;:; ^"di h---*\*r-' '/ri* tho h-^chc in -he Line course were very easy to read, 
Wr.'i* l :.:>c lis-? *oy.ture cJ-ii^s'. Vf^re they very easy? 



• '-4 *jr, 
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101 con 

1 

Ad (rou finish your pictur^^s? 
; * e(| ) 

? Did you k..^** bow to use the camera before? 
A (Yes) But not that kind of camera. 

? You never used that kind of camera before? 

A (No) 

V Did the book about the camera help you learn hov to us<? the '^rmrrn.^ 

A (Ves) 

? :r another student asked you, *Vhat doe. the word lox^t^r*^ mean':*' 

would you say? 

A Oh, tell them texture is feellngf.*. 

: Or? 

v\ Visual, seeing, looking. 

? That's two ways to learn ubout texture, rlrht? 

/- Ye?S. 

? Is there anything? you don't like about the *trt clirr. r.ov? 

A Ilothinff, T told you before. 

? T a.*!: trj'ln#? to be sure that you still like It, 

A I told you that clay is not tvy favorite. 

? Put the texture is ^.K.? 
n * r» • 



Anything else? 
A Tse?— I call you a nos^v mar;. 
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Tapo Location • '.OS-'/^' 
Interviewer - W. (Jrant. 



T Vou hrivt' ,1u/.t I'inisjlied an aru class about texture . Can you tell me two 

A Two wnj/.^V Bourh and snioot h. 

? ?Io. tr.-.^o nr*-* n^un<^i«, two v^iys to learn about texture? 

C Hov do you know about the texture of something? 

: C.K..» wo will do that later. Do you know the names of all the textures? 

A (v..r) 

? Can you tell m*- the texture of that? (eraser) 

A rr.oo^h and soft and«.. 

: And? 

A Ma^t^ 

? And vhat about this one? (Keys) BEST COPY AVAILABKE 

A Hard and rhlny. 

? rhiny? How so y^u know that it Is shiny? 
A hit-^ hi*rhl1.-htr. 

fir. i rrurh and rr.oDth 

t ^J: Ml*, thir (rubber band) 

A .'"f* « r.V.V^ /.TT.rotii* 

? riiv^. r->T.<^r.: '^r yoi Viad to read s'one hooks, were they hard to read? 

? W-.at ibout the machine*: Vou 'ined a machine called a dynedia. Was that 

hard. . * 

A Kv-;,' , 

? Did you l!ko to ui^e that? 

ft ^ V 

M - • f * • 



Did y.-^u^ur-e '\ ?»imera? 



? rid you hnoA' hov to use ^hal canera before? 
A >s * 

? If another student comes up to you and talks with you about texture, can 

you tell him what the; word •'texture" means? 
A A s^.udont thourht T Tas pla^yin? with the camera. I told him it was for 

clar.n. T war> trr/inr to pet texture for n^y class. The other student ].-fi . 



BISt con MiMUHE 



V WliMt i.v-^ the woni ^'toxturv** nt-Hi^V 

A dlt*fer^nt thinicrs, .^mooth^ roTt , hnrd, ron?-i:, .•^;ir.:/ -tr.-^l r-rit!f. 

V Tt rtie-ms hov somethiriif loukj... 
A Looks ^ yes. 

V And 

A Teols^ 

IVo vv.^"^ to learn about ^extur^ iire hcv nom^thin^T 3ockf^ ur.d fO-^lr^* 

A f ^ 

Iv-T'^ there ar^v rrohlens with clas.rV 

A (:;o) 

T* vaa a fine class ? 
A V--r^ alrirTht. • 

Th- teacher was holrful. 
A Put, £:orTietimes , I (had to) wait, I wai* for the ^^ev.^J-.-r th.^ t »--ifJ:*.*r 

helred the other i?tudents. 

? Did you have to wait too lon^ son:'?t ir.e.'^ ; 
A ?-r. rrJnutes. 

C Ten r.inutec? V/owI 
A Wai* , wait, wait. 

^ r!i ycu tell the teacher? 
A Walt, r»3,v "help ne" 

lielL- rr*e unierstar.d r^ore 

then the teacher h^-irs rr-. 
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♦ ^ 



. .... 



Tape Locution - [^7'>^*'0 



I no»^.i ir»k you r.ome questions about textures. Can you tell me two 
way.- t.;^ I'-'trr. nb'*^M* *''^xtuf'es? 
Vit'ual 'ind f^t^linr. 

rr-v^l ! r.;- or * oucl.l rif*?. 

Can :.'."^u r-^rr;t^r:l*or rill the names of textures? 

I am just asking because I want you to tell me the texture of that (eraser) • 
"oft und ;Tmooth. • . 

And: 
Matte 

;Vhat about that: (keys) 
Hi.ThliPThtc?. 

Whit does that rieanC 
fhiny, hard and rou^h. 

What ahr>ut this onf='? (rubber band) 
S^oft , sr:OOth -ind. . • 

AndV 

Vh vouid lih-? tv? knov now you feel about ucinp the dymedia- Was that a 
*To^d v'l;/ to loarr. or not or it doesn't ^natter? 

Havt* you f ir.i.'^hr-d usin^r the crcnora? 
Did you *t all ycur rictur*'>;:» 
(Yeo^ 

Did you re* ^.J;vr -xll rirht? 
The carer a va^* ^*Hr:y to u?e? 

First T rr.ad'? c^cre rr.i stakes, but then it was Ok. 
Put there is a rock help you do that. 



8£ST COM 



Can you tell mo vhnt the word texture means? 
Texture? 
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V-\', vh!it i.loej it. !:;^vttiV 

dooiS the word it;ieir rneanV 
It rvr^nnrf to foel wha^ it lorkr like. 



C To tV^?l what it looks^ like: 

A .1 r.ean both, 

i Vv>u rri-^-ir. both what it feelr. like arid whit it looks like? 

*: rlov va.; tho class? OK? 

A* . * If 

rr? rei^ular 

V Tc - r-^,.^uis^r, why? Hot enourh variety? 

A I-uT "he cla^;:? ir Jifrv^rt^nt all the time. 

V di fferen- all tire. 
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interviewer - W. Irui.^ 



? V.-^u lofirn*'d about toxttire , ri^^^ht? 

A Voi; 

• Do ycu kr:ow nil ♦^l;'^^ nriner of the textures? 

A Von 

C Car; you tell two vaj*^s to learn about textures? 

A (?) 

? Two wa;.-:? tc learn about texture? 

A 

? O.Ki.^ Can you tell me another name for texture? 

A i^ooth 

? That's *be nar.o a t'^xture. What is another name for texture? 

A T-K-X? 

? Do you remember the name "Surface Quality"? 

A {\ec^' 

? Cmi yc'U t-^?ll r.? the texture of that? (eraser) 

A Matre, sr.ooth, hard. 

? Wna*. about that? (Keys) 

A (rt;ir^v) H'whli.^ht;"^ ^ hard, smooth. 

? Wli'it nbout that? (r'ibb^?r band) 

A Mat*o, ro.ft .^riooth. 

? Did you us-^ a dj.'r.edia machine? 

BEST COPT MMMtE 

A Ye? 

C Was it har.i *o u?o^ 

A IIo 

? It was OK? 

A Yes 5i rood one 

? Did you finish your rictures? 

A Yes 

? Did you p-et thf»ir ^11 finished? 
Yes 

? Did you set them all riffht? 

A All but two. 
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A T:\o tv.> pictures^ wIxqix 1 first took th^* i ioturoc viMi th»* c^ur.or^i ! 

r.i:5t akf»r» • I couldn't r.t^t the hi^^hl Thf* ti*^oond tirrK- I trifle t/"r!V*v*t. 

lo there anything now that you don't lik*.- '•itout tho art rrifmu*. 
A Alwuys working? on IP's. 

V You don't like that/ 

A I'ince I coxne I am still reading^ that's Hr*i 

i '>ui you learn about textures by seeing ar*J touching? 

A {Vm.O 

? I;: that two ways to learn about textures—^by 3*?ein«? h\v\ touchim^? 

^ W:*=^n you read the books, were they hard? 

V W- rr* they easy? 
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i ntorviewf^r • W. ^imr^t 



Can you tt^ll ^w- v%*.- t..-? lenrn ibout texture? 
A Two ways? 



;-:ow '**ir; :/oi4 i---'jrn ritnut i^x^ur^'^. 



* A- 



? ran yo.i *: "1 1 r,*^ ?.n *y:er nn?r<* f^r t'^xture? 
? I -^ y.vi !vr:i*^r.b^^r nar.^ ^'surfac** quality"? 



v;vll, rr/AV: o yo\: ii ir/*. n-"^'^ before. Can you t'^'^ll me the texture of thu*-? 

;:ir . • • 



*i'y 



VI;h* 'ttou* *r.-:*'. !r:H--^r i'ltiti) 
/of*. 



BEST COPY AVAILABU 



? Vcu h'^ci t ' I'r'ii .^oro V.o:;kr:» Wf»ro they hard to, read? 

? Wh'it abc^'it *h*^ iyr/^dii r/i i n*'* , vaa that hard to use? 

? The dyriie i l u naf^h 1 ne . 

A Ver:.' f*aay, T u:;d^ri^^and, yncAi button, oar>y. 

? Whv ? 

A It war. ^acy, rurh tho button, check the quooMon, rot th^n all ri^ht, eriry* 
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V hid you finish with the eawera? 
A .v^t yet. 

V r^id you know how to use the camera bt^for*'; 

A Very easy^ yes, last year in Hc^ience T uried ^h** ^^on* ra, th^y w^^n*^ 
the r>Hme. 

If another student asks you "What Ic^of ^.h^ vori V->:t -ir" r/^nr;?** V/hv ^nu 
you nriy? 
A -irfhit does texture mean? 

A feel. 

: ?ieht. 

A Ariin, your question? 

iJhat does the wora texture mean? 

7 What does it mean? 

A L«,':'ok, or feel. 

? r:-)w VP will go back a^^^ain, what ur<^ two wiyr - I'-irr. 'xVci*. ^'.-xtur'fV 

A Foelinf?; and seeing? - Dumb me. 

V Tr ♦here anythins: that you don't liko ul - 'ir* 
A The art class now? 

^ Is it still O.K.? 
n Vo.:., T like art. 

1 Is it bcring sometimes? 

A No 



